Optimal Controller Design Algorithm For Non-Affine in Input Discrete-Time Nonlinear System
نویسنده
چکیده
Convergence is proven of the value-iteration-based algorithm to find the optimal controller in the case of general non-affine in input nonlinear systems. That is, it is shown that algorithm converges to the optimal control and the optimal value function. It is assumed that at each iteration the value and action update equations can be exactly solved. Then two standard neural networks (NN) are used: a critic NN is used to approximate the value function while an action network is used to approximate the optimal control policy. © 2012 Jordan Journal of Mechanical and Industrial Engineering. All rights reserved Keyword: Optimal control; Adaptive critics; Approximate dynamic programming; Hamilton Jacobi Bellman; Value iteration; Policy iteration * Corresponding author. e-mail: [email protected]
منابع مشابه
A class of multi-agent discrete hybrid non linearizable systems: Optimal controller design based on quasi-Newton algorithm for a class of sign-undefinite hessian cost functions
In the present paper, a class of hybrid, nonlinear and non linearizable dynamic systems is considered. The noted dynamic system is generalized to a multi-agent configuration. The interaction of agents is presented based on graph theory and finally, an interaction tensor defines the multi-agent system in leader-follower consensus in order to design a desirable controller for the noted system. A...
متن کاملDesign of a Novel Framework to Control Nonlinear Affine Systems Based on Fast Terminal Sliding-Mode Controller
In this paper, a novel approach for finite-time stabilization of uncertain affine systems is proposed. In the proposed approach, a fast terminal sliding mode (FTSM) controller is designed, based on the input-output feedback linearization of the nonlinear system with considering its internal dynamics. One of the main advantages of the proposed approach is that only the outputs and external state...
متن کاملA New Near Optimal High Gain Controller For The Non-Minimum Phase Affine Nonlinear Systems
In this paper, a new analytical method to find a near-optimal high gain controller for the non-minimum phase affine nonlinear systems is introduced. This controller is derived based on the closed form solution of the Hamilton-Jacobi-Bellman (HJB) equation associated with the cheap control problem. This methodology employs an algebraic equation with parametric coefficients for the systems with s...
متن کاملDesign of a Constrained Nonlinear Controller using Firefly Algorithm for Active Suspension System
Active vehicle suspension system is designed to increase the ride comfort and road holding of vehicles. Due to limitations in the external force produced by actuator, the design problem encounters the constraint on the control input. In this paper, a novel nonlinear controller with the input constraint is designed for the active suspension system. In the proposed method, at first, a constrained...
متن کاملIterative learning identification and control for dynamic systems described by NARMAX model
A new iterative learning controller is proposed for a general unknown discrete time-varying nonlinear non-affine system represented by NARMAX (Nonlinear Autoregressive Moving Average with eXogenous inputs) model. The proposed controller is composed of an iterative learning neural identifier and an iterative learning controller. Iterative learning control and iterative learning identification ar...
متن کاملOptimal discrete-time control of robot manipulators in repetitive tasks
Optimal discrete-time control of linear systems has been presented already. There are some difficulties to design an optimal discrete-time control of robot manipulator since the robot manipulator is highly nonlinear and uncertain. This paper presents a novel robust optimal discrete-time control of electrically driven robot manipulators for performing repetitive tasks. The robot performs repetit...
متن کامل